cal systems. Subsequently, these experts will give the unit
an overall effectiveness rating and provide explanations
for any scores outside a neutral or mid-range value.

The commanders will use two frames of reference.
First, drawing on personal experience, they will rate units
on a relative scale. For example, the high end of the rating
scale might be, "one of the best performances," and the
low end, "one of the worst performances." Because any
given expert's experience may relate to generally very
good or very poor units, the raters will use a second frame
of reference pegged to combat proficiency. The high end
of that scale might be, "completely effective perfor-
mance," and the low end, "completely ineffective."

In making these assessments, the expert raters will
review the mission orders, the digital data tapes fed
through the computer system that displays vehicle posi-
tions and firing events, the synchronized radio-net audio
tapes, map overlays, and documented comments from
the National Training Center staff that indicate any spe-
cial conditions. Researchers at the center will use averag-
ing to reconcile differences in the experts' ratings. W here
ratings are extremely discrepant, researchers will look to
the experts' narrative comments for insights into how
best to interpret the data. Clearly, the use of experienced
battlefield commanders to observe and judge recorded
exercises at the center promises to alleviate some of the
data collection and data interpretation deficiencies
inherent in a strictly mechanical performance measure-
ment system.

Although the realistic combat simulation achieved at
the National Training Center facilitates effective unit
training, it offers only limited opportunities for acquiring
high-fidelity measures of unit performance, as we have
discussed above. Fortunately, a new combat simulation
system now being developed by the Defense Advanced
Research Projects Agency and the Army will make pos-
sible the kind of precise measurement not attainable in
actual field exercises. Moreover, it will do so without any
intrusion from data collectors.

As its name suggests, Simulation Networking or
SIMNET, is an integrated network linking together var-
ious battlefield weapons systems simulators, Eventually,
the network may comprise hundreds of simulators for all
major weapon systems. This will enable trainers to con-
duct force-on-force exercises on a combined-arms, bat-
talion task force scale (as is possible at the National
Training Center) or larger.

Each simulator in the network will have a video-
display screen that realistically depicts the battlefield ter-
rain as well as any systems and vehicles in the operator's
simulated line of sight. Through real-time, computer-
generated imagery, any maneuvering, firing, and changes
speed or position that an operator of one simulator
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initiates will be automatically projected on the line-of-
sight display screens of the other simulators in the net-
work. Realistic sound effects and vibrations will add to
the fidelity of the simulation.

SIMNET will also record exercises in their entirety,
thereby enabling trainers and researchers to replay each
simulated battle and systematically analyze the data it
generated. By incorporating mission scenarios similar to
those at the training center, training officials expect to
use the Simulation Networking in tandem with the per-
formance measurement system that the Army Research
I nstitute and the Combined Arms Training Activity are
developing for the center.

The great potential of SIMNET for generating high-
fidelity data increases the feasibility of conducting
research on the new measurement performance system
itself. For example, SIMNET will reveal the degree to
which observations and judgments of military experts are
consistent with the systematically calculated assessments
that analysts will make using the objectively scored per-
formance and mission outcomes. Analysts will also be
able to determine the degree of consistency for objective
and behavioral performance measures and for overall
ratings of unit performance effectiveness.

The National Training Center can produce data that
describe the performance of units, their leaders, and their
equipment during simulated combat missions. Together,
data from the center and from the SIMNET technology
promise to provide new insights into the interactive per-
formance of complex weapons systems typically used by
units to perform various critical missions.

Although data currently logged at the center have lim-
itations, recent initiatives to combine the objective data
produced by the Multiple Integrated Laser Engagement
System and position-locating electronic equipment with
data provided by trainers, observers, and battlefield
experts should help the Army increase its warfighting
capability. While analysts and tacticians must take care
not to overgeneralize when applying data gleaned from
exercises to actual combat, such data are nonetheless
central to formulating valuable, insightful, and instruc-
tive Army lessons learned. DJV\J
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